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ABSTRACT 

The regular cert i f i cat i on of arts and science 
graduates who have riot completed the necessary professional education 
courses has become state policy recently in several states arid others 
are considering it. These four studies, .provide data on • two research 
questions related to this policy: (11 What, if any, differences in 
scores on teacher cert i f icat ion tests occur tor two groups of _ 
teachers: those who have completed teacher education or certification 
programs, and those who are temporarily certified (arts and sciences 
majors^? and ( 2} What , if any , differences exi§t in oh- the-job 
performance of the aforementioned groups of teachers as measured by 
evaluation /instruments currently in use? The methodology , results , 
and conclusions of four related studies are presented: (1) a study of 
scores on' the Georgia Teacher Certification Tests for teachers with 
regular certification and provisional certification; (2) a study of 
scores^ on the National Teacher Examiriat ioris_ f or teaches^ with regular 
and _ terf\po*rary .certification in Louisiana; (3) a comparison of the 
performance of classroom teachers in a metropolitan school district 
who h^ve graduated from arts and sciences or teacher education 
programs; and (4) a comparison of performance and test scpres for a 
selected population of teachers with provi sionai* and regular 
certification in North Carolina. (JD) 
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INTRODUCTION AND PURPOSE 



There is a growing awareness arid deter initiation across the nation that the curric- 
ulum of the public schools must be strengthened, and that the caliber of teachers must 
be improved. Insuring that prospective teachers master general education components 
and maintaining the quality of content to be taught are increasingly important objectives* 
Mandates in numerous states now require that beginning teachers demonstrate minimum Compe- 
tencies on written tests that focus oh basic skills and/or content to be taught. 

The emphasis on employing teachers who knew their subject matter has refocused 
attention on the employment of liberal arts graduates with preparation in a major subject 
field, even when a pedagogy sequence has not been completed. This policy is a reacuori 
to the shortage of qualified teachers in certain fields, such as science and mathematics, 
as well as the recognition that persons with such preparation may have much to offer 
in teaching positions. 

The SREB Task Force on Higher Education and the Schools, in its report The 
Need for Quality, (SREB, 1981) recommended that states modify their certification 
requirements to allow provisional certification of all beginning secondary teachers, 
including arts and sciences graduates, "with safeguards to insure the quality of instruction," 
The 1980 report of the Commission oh the Humanities (Commission, 1980) calls for 
state departments of education to base certification requirements on solid liberal edUca-" 
tibh of applicants. The Commission expresses concern that the minimum competencies 
now required in teacher testing may in fact become norms. The Commission also questions 
the prevailing system that for the most part excludes those who are academically prepared 
in various humanities disciplines but Jack a required number of education courses- 
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As states consider the possibility of opening certification to arts and sciences 
majors, several questions arise. Will such majors be ab!e to handle the classroom? 
Are these graduates suf: xiently aware of differences in student abilities and cultural 
origins? Does knowledge of subject matter Imply being able to teach that information 
%t the level of high school students? 

There is a need for data on the actual performance of arts and sciences graduates 
in the classroom, and on how they score on teacher certification tests of subject matter 
knowledge and pedagogy. The increasing pressure bh state certification officers for 
revision of certification rules calls for data and research on this subject. 

Several policy questions are related. If it is found that the classroom performance 
of beginning teachers who have hot had a pedagogy sequence is similar to those who 
have, then the effectiveness of pedagogy sequences is open to question. If, on the 
other hand, the performance of arts and sciences graduates does hot measure up to . - 
the performance of teacher education graduates, then the policy of certifying them 
should be questioned. Data on performance after the first or second year may indicate 
whether on-the-job experience does or does hot make a difference in the assessed per- 
formance of the teacher. Results will need to be interpreted iri the context of methods 
used to assess performance. 

An examination of the test scores of arts and sciences graduates and teacher 
education graduates should indicate whether or not a difference in subject matter, 
general education, arid professional knowledge does exist among those entering a teaching 
career. Test results may reflect preparation programs or self-selection by students 
into particular college programs. Research has not substantiated any relationship between 
the level of ability to score on a test and performance In the classroom. This may 
indicate the complexity of the classroom. Current teacher certification tests have 
cutoff scores set at minimum levels, hence their present purpose is to screen out those 
who cannot pass a minimum standard* arid they do riot necessarily predict who might or 
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might not perform well in the classroom- In either case, policy questions are being 
asked about the attractiveness of teacher education programs and of the teaching pro- 
fession to talented individuals, and data for making decisions will be helpful. 

Data are now available from several states which permit comparisons of groups 
of arts and sciences graduates with teacher education graduates in terms of their 
knowledge base, as measured by a standardized test, and by their performance in the 

✓ 

classroom, as measured by systematic evaluation instruments. 

Two rer^arch questions are posed for each set of data. First, what differences 
exist in scores on certification tests which measure knowledge of subject matter, general 
education, professional education, or a combination thereof, for employed teachers 
who have graduated with arts and sciences degrees and those who have graduated 
from arts and sciences programs? A second question is: What differences exist in 
on-the-job performance of teachers, as measured by performance assessment instruments, 
for employed teachers who have graduated from arts and sciences programs compared 
with those who have graduated from teacher education programs? 

Several areas of research are related to the questions posed. What is the present 
status of certifying arts and sciences graduates? What is the relationship between 
a liberal education for a teacher arid pedagogical knowledge? How do arts and sciences 
majors and teacher education graduates compare on tests of academic knowledge as 
well as on-the-job performance? In addition, information is sought about the instruments 
used to evaluate classroom performance as well as tests used for certification purposes. 
What is the relationship between how well a teacher scores on a test or is rated in 
the classroom and student achievement and attitudes in school? 
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RELATED LITERATURE AND ANALYSIS 

Certification of Arts e nd Sciences Graduates 

Suggestions or recommendations have been advanced in several states to provi- 
sionally certify arts and sciences graduates on the same basis as teacher education 
graduates. In the SREB region, only two states have moved to permit certification 
of arts and sciences graduates for secondary school positions. In Virginia, arts and 
sciences graduates may be provisionally certified and then must complete nine hours 
of approved courses or an alternate program approved by the state superintendent 
of education. In Florida, legislation has authorized the employment of persons with 
subject matter preparation but no professional education courses, to be implemented 
by districts under Board of Education guidelines. Nationally, California and New Hampshire 
have provisions for certifying arts and sciences graduates, and several other states 
are discussing proposals. Other states may give provisional certification to arts and 
sciences graduates, but in some of the states that have state salary schedules such 
teachers do not earn the same salary as those who have graduated from an approved 
program or have completed the necessary education hours. Teachers in these states 
have to earn the necessary education hours to attain regular certification. 

Teacher E d ucation versus Liberal Arts Education for Teachers 

The question of whether or not the education of teachers should include courses 
on pedagogy is not a new dimension in examining the quality of teachers* The influence 
different types of training programs have on the effectiveness of a teaeher were summa- 
rized in the 1969 edition of the Encyclopedia of Educationa iResearch , which discussed 
several studies that focused on the same question during the early Sixties. Results 
were mixed but the authors concluded that the "results are hot very encouraging"; 
several studies indicated that having gone through teacher training programs did make 
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a difference and others reported that training to be a teacher made no difference except 
that teachers who were trained had greater objectivity. 

Present arguments appear to center around the inability of schools of education 
to attract large numbers of bright students and on whether or hot students studying 
to be teachers should concentrate their work in academic areas as opposed to courses 
in pedagogy. According to a recent summary of the question in Educational Testing 
Services' Teacher Comp etence , (1982) the National Accrediting Association for Colleges 
of Education (NCATE) notes that there has been an erosion in the amount of time devoted 
to pedagogy coursework, with an increase in arts and sciences courses. The intellectual 
content of the education programs has been attacked by X Myron Atkm, dean of the 
College of Education of Stanford University. Others argue that teachers must learn 
by doing and that teacher education cannot be fully taught in the college classroom. 

Performance Evaluatio n 

Studies examining the on-the-job performance of teachers have produced mixed 
results, but generally have found that the teacher who has regular certification or 
has completed a teacher education program performed better in the classroom according 
to ratings from superiors. 

When effectiveness of teachers was measured by a rating scale administered 
by school principals, provisionally certified elementary teachers did less well than 
Regularly certified teachers in planning and preparation, subject area knowledge, student 
evaluation, and pupil-teacher relations. Ho significant differences were found in the 
following areas: instruction (ability to motivate students, use instructional materials), 
parent-teacher relations, arr<i human relat ions with colleagues in the school and community 
(LuPone, 1961). 

Beery's (1962} r&^arch in elementary and secondary schools in Florida found 
that Jirst-year teachers ' ho had completed sequences in education courses were rated 
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significantly higher than those who had not. The ratings were made by education personnel 
as well as laypersons from outside the school. When principals' ratings only were used 
to compare teachers in the same school, the mean ratings favored the fully certified 
teachers, but not at a statistically significant level. 

Hall (19€U) completed a study in Florida of first-year elementary teachers and 
found that student achievement gains were significantly related to hours of education 
courses that had been completed by teachers- Student achievement scores favored 
the fully certified teachers, especially in word meaning, paragraph meaning, and language. 

la a study conducted In Georgia in i967, teachers who had regular certification 
were compared to those who held temporary certification because they had not completed 
the necessary number of education hours. Using an instrument similar to the one used 
by Beery, the regular teachers were found more systematic and responsible, more skilled 
in use of teaching media, and generally more competent {Bledsoe et al., 1967). 

A 1 57 1 study by Popham compared experienced teachers with persons from outside 
the schools, such as an electrician, in their ability to teach high school students a unit 
lasting from k to 9 hours. The achievement of the students was measured through 
post-testing after the materiai had been presented. The students of the experienced 
teachers scored higher*. but differences were not significant. A study by Bausell and 
Moody (1972) reported that students taught by inexperienced student teachers learned 
as much as those taught by experienced teachers; 

Copley, in his 1975 study of ratings given to teachers by principals, found that 
in areas such as communication skills and consideration of pupils, teacher education 
graduates were rated higher than those who had no student teaching or those who possessed 



an arts and sciences degree, but no difference was found in planning arxTbrgajj&tior!, 
knowledge of subject matter, or personal characteristics- 
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Test Results for Teacher Education and Other Majors 

Students who intend to major in education have historically ranked near the bottom 
third for all majors on achievement and aptitude testing, and the situation is getting 
worse- Declines in English and mathematics scores between 1970 and 1976 were shown 
to be greater for prospective education majors than for ail other majors (Weaver, 1979); 
Scholastic Aptitude Test (SAT) scores for 1982 indicate that the average verba! SAT 
score ranked 32 points below and mathematics scores averaged ^8 points below the 
rational averages. Education ranked 26th out of 29 majors; only home economics, 
ethnic studies, and vocational studies ranked lower. 

Recent information from the National tenter for Education Statistics (NOES, 1982) 
indicates that for high school graduates of the class of 1980, those intending 
to major tn education had lower achievement scores and lower self-reported grade 
averages, had taken fewer mathematics and science courses, and a smaller proportion 
of them had been in academic programs in high school, compared to students declaring 

\ 

all other majors. 

In a study of 1979 graduates of public and private colleges in Virginia, it was 
found that mean SAT scores of graduates certified to teach were lower than those 
not certified to teach; However. It was noted that the difference in scores by institution 
was greater than whether or not graduates had the qualifications to be certified; The 
Fesearchers do indicate that conclusions drawn- from the evidence and general findings 
should be viewed with the knowledge of the aggregation of data and nature of the SAT 
(State Council of Higher Education for Virginia, 1981); 

Results of the Graduate Record Examination (GRE) scores show similar trends. 
Verbal scores of intended education majors dropped 22 points from \Wk to 1981; mathe- 
matics scores dropped 7 points. For ail candidates the drop on verbal was 20 points, 
but mathematics scores increased by 13 points from 197'+ to 1981. / 
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Intended education majors also ranked -car the bottom in comparison with aii other 
srttertd«?i majors (Hardy, 1932). 

In SifcfitiBh. it is.ocinted out that school? have been just as ^iliing to hire id* 
ig teachers as high scoring teachers (Weaver* 1979; v anje and SchiecHty, 1982). 
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Teacher Tesring and Its SM&U^ 

Several studies have examined the relationship between the National Teacher 
Examinations (NTE) and ^f^ftvaffkre in the classroom. "For the most part, studies ; 
have been conducted using observation instruments that principals or supervisorsfcTnptoyed 
to assess the performance of student teachers or teachers, in general, |o* correlations 
have been observed (Quirk, Witteh, and Weinberg, 1973); A study of the n^ationship 
between the Common subtest scores of the NTE and teaching styles found corrections 
with a median of .25 (Medley and Hill, 19701 Another study which examined Weighted 
Common scores, selected Area Examinations, and supervising teachers' ratings reported 
signif ah^'ce -relations, both positive and negative. The authors questioned the rating 
instruments!^ were used (Andrews, BlaCkmon, Davidson and Mackey, 1982). A study 
of performance'^ student teachers' assessments by university supervisors in relation 

y 4£ .... ,. 

to the NTE elementary education test reported a significant correlation of M (Piper 

i 

and Sullivan. 1981). Correlations of the NTE area tests in mental retardation, early 
childhood, and phy^c'aJ.education as well as the professional education subtest of the 
Common test and the Common scjire were correlated with on-the-sob performance 
as measured by the Georgia Teacher Assessment Instrument (fPAth Corrections ranged 
from -.1 2 to .52 (SREB, 1982). in general, the findings of the studies support the conten- 
tion of EdacStionai Testing Service tha* knowledge is only one part of the complexity 
of classroom teaching (ETS, 1978). 

A recent' study examined the relationship of. the scores on the Georgia Teacher 
Certifications Test wi h the results of the Teacher Performance Assessment instrument 
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inr hegm^mg tvarh^rs ,tnd tou'vl that for tin* I * r 5 1 assessments in the fali; Correia- 
:„..m<> !<mdec to br po*u:;\e, but Ver % sm ill, rahgng from ,05 \d < 3 * for academic subjects. 
y.v<„ c-^j/v-jj', r-r art. Hniiu- eoe^orm >. ,v 1 rnuMC dli showeH vcrv small negative correlations 

Teach*" T#»<tin|^ w Per firrmarn;:*.r I: valuat ion, a he '^tudera: A chi e v yrner?: 

There ha« h'*en httie research on th<? relationship ot performance assessment 
or testing of teachers with achievement and attitudes of students. Mixed results were 
obtained in a study which examined student achievement and attitudes as they related 
to Sow jnfererr.-o teaching measures How inference Instruments measure the presence 
or absence of teacher behaviors - a classroom'' (Taker. Merilev, S-;ah • 980). A stiidy 
^vammmg the relationship of the Georgia Teacher Performance Assessment Instrument 
with student achievement found a significant relationship between the TPAI ratings 
and ;*\icher-made tests- ^Hen student achievement was measured by standardized 
tests., the results were mixed (Capie, 198!): 

Some studies report relationships between the National Teacher Examinations 
and .student achievement. However, many of the studies are beset with methodolog- 
ical problems. An early study by Lins (i 9^6) showed moderate correlations between 
student achievement and the &TE Common Examinations, However, small samples were 
used- ft study of the relationship between the National Teacher Examinations Common 
test and student achievement in mathematics and vocabulary found significant relation- 
ships (Sheehan and Marcus, 1978). However, they cite another study showing an inverse 
relationship between teachers 1 NTE scores and pupi! achievement. 
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J f A< • \} ? r . P. ?.r * ° r r P 4 I n Instruments 

'Orient ions arise -as to the validity and reliability of teacher observation instruments 
used by states and districts to evaluate teachers on the job. 

Most of the instrumentation appears to have sufficient reliability and validity 
to support use. However, it might be noted that most reliability data co'^sns interrater 
agreement, which provides information on the use of the instruments the clarity of 
the language; and training of the observers. According to Medley and Mitzeli (1963) 
this coefficient of observer agreement tells us something about the objectivity of the 
observations, but nothing about how closely the obtained score approximates J true 
score (the day-to-day behavior of the teachers as opposed to what is observed on one 
ocrasion): Other reliability of the instrument can be low, even if two observers agree 
exact I v. because of errors that arise from changes in behavior of the teacher from 
one occasion to another. Dickson and Wiersma (1980) note that teacher observation 
depends highly on the instrument in use. 

Instruments currently in use are generally developed from a "consensus" 
model; from a research perspective, or fro n a combination of both. In a consensus 
model, competencies that practitioners "believe" to be associated with effective practice 
are assembled. However, what is thought to be characteristically effective practice 
may not be the case wi:en the behaviors are correlated to student aehtevertflnts and 
attitudes, as reported in the works of several authors (Rosenshine, 1976; Medley, i977; 



Coker, Medley ic Soar, 1980): A second method of developing evaluation systems is 

to use the current research base, which Sinks particular teacher behaviors with student 

outcomes. Most of the research in this area has been conducted in elementary schools 

with low socioeconomic students, therefore, teacher behaviors linked with student 

achievement may not be the same as behaviors linked to achievement of secondary 

or high achieving students. A recent studyTTas questioned the generic character of / 
■ . .... / 

the observation instruments in use (Southern Regional Education Board, 1982). 
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Research on assessment instrumentation is sparse* especially that which examines 
specific teacher competencies associated with student achievement arid attitudes across' 
a variety of ages and subject areas. According to a recent critique of teacher evaluation, 
methods used to evaluate teacSSrs are inadequate. Soar, Medley and Coker (1983) 
criticize rating scales to evaluate teachers because of their inaccuracy in measuring 
the performance of teachers, their lack of validity, and because they are susceptible 
to the "halo effect/ 1 They report a number of studies to support their contention that 
ratings of teachers 1 performance by trained observers have "no validity as predictors 
of teacher effectiveness 11 (p* 244) when the criteria is student learning. 

Questions also arise concerning who should be doing the observations in the 
classroom— principals, peers from within the school, or peers from outside the school. 
Studies have shown that there are not substantive overafi differences in ratings related 
to the type of observer (Hawkins & Stoops, 1966; Hamm, Liu, Brinlee, 1983). However, 
it has been noted that differences occurred in ratings that teachers, district administra- 
tors, and peer teachers gave on classroom management and communication on an instru- 
ment used statewide. District administrators scored teachers significantly lower than 
teachers or principals on classroa^Ti management, but on communication, principals 
scored teachers higher than district adminstrators and pet^ teachers (Hamm, et ah, 1985). 

•ir 
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METHODOLOGY, RESULTS, AND CONCLUSIONS 
OF FOUR RELATED STUDIES 

A StuSy of Scores on the Geor&ia Teatfier Certification Tests for 
Teachers with Regular Certification and Teachers with 
Provisional Certification 

This is an ex post facto study examining the differences between the scores on 
the Georgia Teacher Certification Tests (TCT). The study assesses teaching field knowl- 
edge for two groups of teachers: (l) those who have completed a regular teacher education 
program feeding to a bachelor's or master's degree, and (2) those who have completed 
an arts and sciences program leading to a bachelor's or master's degree and do not 
possess enough hours in professional education courses to be regularly certified. The 
variables of the study were: 

1 . The scaled scores on the Georgia Te acher Certification Test . 

2. Area in which the teacher took the Teacher Certification -Test ; 

3. Type and level of program completed by the teacher: approved teacher 

education program at the bachelor's or master's level or an arts and 

sciences degree at the bachelor's or master's level, as ascertained from 
type and level of certification* 

\ 

Populati ons 

The population for the study was composed of teachers who were employed in 
public school systems in the-state of Georgia for the 1982-83 school year, had taken 
the Georgia Teacher Certification Test during the three testings in 1981-82 or during 
the three testings in 1982-83, graduated from approved teacher education programs 
and possessed professional certificates (NT-4 T-VNT-5, T r 5), or graduated with arts ; 

. . • - -.. . 

and sciences degrees and possessed provisional certificates (B-*, B-5J as their only 
certification. (See Appendix B for information on certification.) All teachers had 
three or fewer years of experience teaching in Georgia. J 

J 

\ 
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The computer data base of the State of Georgia Department of Education was 
the data base for the project. All data were treated with utmost security. 
Group data were used with no identification of individuals at any time. 

Instrumentation 

Georgia Teacher Ce. Jfication Tests * The Georgia tests are criterion-referenced 

tests that assess ah individuals knowledge of content in his or her teaching field. The 

tests were developed a? part of the performance-based certification policy of the State 

of Georgia. Cutoff scores and minimal performance standards were set in 1977-1978 

by the Department of Education; cutoff scores are two and one-half standard errors 

of measurement below the determined minimal level. The tests were designed to reflect 

the curriculum in Georgia public schools. A large number of teachers reviewed objectives 

of the tests in order to maximize the degree of content validity. The reliability data 

are expressed as Kuder-Richardson 20 coefficients. The coefficients on the tests range 

from 0.85 to 0.9*. The final scaled score is an adjustment of raw scores so that the 

same cutoff score of 70 on all of the tests corresponds to different percentage-correct 

values, depending bri the test taken (Georgia State Board of Education* ri.d.). A study, 

which examined passing rates of graduates of the University System of Georgia the 

first time that the tests were taken, found'passing rates based on the cutoff score 

♦ 

of -70 varied for different subject areas. Passing rates ranged from 55 percent on home 
economics to 97 percent oh music education. These differences may indicate a difference 
in difficulty of tests or differences in populations taking the tests. Since passing rates 
are for first-time test-takers it is not known if differences continue to occur after 
retakes on the tests (SREB, 1982). 
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' Since data for the study wen* obtained from records of currently employed teachers 
who hold a certificate, scores are all at or above the passing scaled score of 70. The 
scores recorded represent either the first attempt at passing the test* if ah acceptable 
score was achieved, or may represent the last score, if a score of 70 was achieved 
in a series of multiple attempts. 

Analyses of the Data 

To determine if differences in knowledge level of subject matter (as measured 
by the Georgia Teacher Certification Test) exist, a statistical summary was made for 
four groups: graduates of approved teacher education programs at the (0 bachelor's 
and (2) master's levels, and arts and sciences graduates at the (3) bachelor's and (*) master's 
levels. In addition, [test scores vere broken down into 5 ranges, and numbers and percent- 
ages of teachers falling into each range were calculated for the programs (teacher 
education, arts and sciences) as well as the levels (bachelor's, master's). The data were 
also examined to determine differences by program as well as level, with interactions 
included, The data were analyzed to determine if differences occurred by testing year. 
Data for the groups were analyzed separately by test areas having sufficient numbers 
of teachers. A grouping was made of all teachers, which included; communicative 
arts, social studies, mathematics, science, French, Latin, Spanish, German, business, 
distributive education, agriculture, home economics, arid industrial arts. Another grouping 
was made for humanities which included: communicative arts* social studies, and all 
languages. All calculations were completed using the Statistical Package for the Social 
Sciences (SPSS) (Nie, Hull, Jenkins, Steinbrenner & Bent, 1975). ^ 
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Results 

* The analysis of the data by testing year (1981-82, 1982-83) reveals that the results 

are comparable and that few differences exist in the data from year to year (see Table !). 

i . _ 

This analysis was complete -i to test the use of only two years of testing data for the 

study. 



TABLE 1 

Mean Scores on the 
Teacher Certification test by Year 



N 



1981-82 



N 



1982-83 



All* 

Humanities** 

Communicative Arts 
Social Studies 
Mathematics - 
Science* 



£*S0 
259 

99 

m 

55 
5ft 



79.2 
86.0 

78.7 
80.7 
Z9.6 
79.0 



223 
116 

37 
71 

ko 

30 



79.1 
81. U 

78.2 
81.7 
78.6 
77.3 



* Includes the total population with theJollowJhg subject^areasj-epresented: 

communicative arts, social studies, mathematics, science, French, Latin, Spanish, 
German, business, distributive education, agriculture, home economics, 
industrial arts. 

** Humanities includes communicative arts, social studies, and all languages (Spanish, 
French, German, Latin). 

NOTE: Subject breakdowns are shown only for areas with sufficient numbers for analysis 



The analyses of the data reveal that for employed teachers with fewer than 3 years 

of experience in Georgia schools the knowledge level as measured by the Georgia 

\ f 

Teacher Certification Tests is more dependent on level of degree than on program 



(see Tables 2 and 3). In general, the bachelor's level teachers scored lower than the 
master's level teachers by around 3.8 points. On the other hand, arts and sciences 
graduates scored slightly higher than teacher education graduates overall, but the differ- 
ences are Sot consistent across fields. Differences by levels were more apparent in 

19 
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TABLE 2 

G eorgia teacher Ce rtification Test 
Scores for a Selected Population by Program/Level 



Discrepancies from the 
Grand Wean 



N 



Grand 
Mean 



Arts & 

legs 



Teacher 

Education Bachelor's Master's 



All* 

Humanities** 

Communicative Arts 
Social Studies 
Mathematics 
Science 



703 
375 

136 
214 
95 
84 



79.2 
80.4 

78/6 
81.0 
79.1 
78.4 



.4 
1.4 

1.4 
.7 
-.4 
-.5 



-.2 
-.9 

-.8 
-.5 
.4 
.4 



-.4 
-.5 

-.6 
-.3 
-.4 
0,1 



3.4 
3.1 

4.5 
1.9 
5.5 
-2.0 



* Includes the total population with the following subject areas represented: _ 
communicative arts, social studies, mathematics, science, French, Latin, Spanish* 
German, business, distributive education, agriculture, home economics, 
industrial arts 

** Humanities includes communicative arts, social studies, and all languages (Spanish, 
French* German, Latin). 

NOTE: Subject breakdowns are shown only for areas with sufficient numbers for 
analysis. 

some particular fields, with greatest differences for communicative arts and mathematics. 
Science teachers at the bachelor's level, however, had higher scores than those at the 
master's. Differences by program were most marked for humanities and communicative 
arts, with graduates from an arts and sciences program scoring slightly over two points 
higher than teacher education graduates. 

Differences within level indicate that at the bachelor's level, the arts and sciences 
groups scored slightly higher than the teacher education groups, with the exception 
of the mathematics and science teachers. (See Appendix A for complete data.) However, 
at the master's level the arts and sciences group scored lower than the teacher education 
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TABLE 3 



Scores on Georgia Teacher Edification Tests by Levels for 
Graduates of Arts and Sciences and Teacher Education Programs 

9 

t 

All* Humanities** Communicative Social Studies M athematics Science [ 

Arts k Teacher Arts* Teacher Arts S Teacher Arts & Teacher Arts* Teacher Arts k Teacher 
Sciences Education Sciences Education Sciences Education Sciences Education Sciences Education Sciences Education 



Total=703 ' 
























Number 




m 


W 


m 


M 


88 90 


m 




55 


36 




Bachelor's 






















. f 


Number 
Mean Score 


sa 

4 


m 

7S.fi 


m 

81.5 


m 

78.9 


m 


79 11 
77.4 82.8 


in 

79,9 


35 
78.3 


52 
78.9 


U 
111 


78.8 


Master's 












•i 












Number 
Mean Score 


37 
81.3 


37 
83.8 


in 


25 
8U 


86.3 


80.9 81.1 


12 
85.9 


i 

81.3 


3 

88.9 


2 

71.7 


78.8 



* includes the total population with the following subject areas represented; communicative arts, social, studies, mathematics, 
science, French, Latin, Spanish, German, business, distributive education, agriculture, home economics, industrial arts. 

** Humanities includes communicative arts, social studies, and all languages (Spanish, French, German, Latin). 
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group; This holds true for ail groups excent communicative arts- In science and math- 
ematics, teacher education graduates outscored the arts and sciences teachers at both 
levels. For communicative arts, the arts and sciences group outscdred the teacher 
education group at both levels. The small numbers at the master's level rriust be con- 
sidered when examining data, particularly in science* mathematics r and communicative 
arts categories. 

The results for all teachers in this selected population, as well as breakdowns 
by subject matter, indicate that subject matter and, to a slight degree, professional 
knowledge, as measured by the Georgia TCT, are more dependent on level than on 
program. A much higher percentage of the teachers who have completed a bachelor's 
degree fall into the bottom of the score ranges than do the teachers with a master's 
degree. Similarly, almost twice as many master's level teachers fall into the upper 
ranges when compared to the bachelor's level teachers. 

To examine the distribution of scores by program and level, total score ranges 
(from 70% to 99.9%) were divided into fifths (see Table <0* By levels for all teachers, 
approximately k5 percent of the- master's teachers fell into the bottom two-fifths ~&t 
the total range, with 7Q percent of the bachelor's level teachers in the bottom two- 
fifths. Ten percent of the bachelor's leVe'i teachers fell in the upper two-fifths; approx- 
imately 20 percent of the master's graduates were in that range. 

By program, the distributions were more similar; 66 percent of thfc arts and sciences 
graduates and 68 percent or the teacher education graduates were in the lower two- 
fifths. Approximately 12 percent of the arts and sciences graduates fell into the upper 
two-fifths of the range; 9 percent of the teacher education graduates were in those 
categories. <v 
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TABLE 4 



Percent of teachers Scoring 
at Various Levels of Georgia teacher Certification Test 



Ail 



88%,= 
93.9% 



test Scores 



$2% - 
87.9% 



76% - 
81.9% 



75.9% or 
less 



Arts & Sciences 2.2(6)* 9,7(26) 22,1(59) 34.8(93) 31.1(83) 

Teacher Education 1.8(8) 7.3(32) 22.7(99) 30.0(131) 38.1(166) 

Bachelor's 1,600) 7.3(46) 21.1(133) 33.1(208) 36.9(232) 

Master's 5.4(4) 16.2(12) 33.8(25) 21.6(16) 23.0(17) 



Humani ti es 

Arts & Sciences 
Teacher Education 

Bachelor's 
Master's 



1,4(2) 
3.1(7) 

1.9(6) 
5.7(3) 



13.6(20) 
7.0(16) 

8.4(27) 
17.0(9) 



27.9(41) 
27.2(62) 

25.4(82) 
39.6(21) 



34.0(50) 
27.2(62) 

31.1(100) 
22.6(12) 



23.1(34) 
35.5(81) 

33.2(107), 
15.1(8) 



Comm unicative Arts 

Arts & Sciences 
Teacher Education 

Bachelor's 
Waster's 



4.2(2) 
1.1(1) 

1.7(2) 
6.7(1) 



30.3(15) 
21.6(19) 

21.5(26) 
53.3(3) 



37.5(18) 
36.4(32) 

38.0(46) 
26.7(4) 



27.1(13) 
40.9(36) 

38.8(47) 
13.3(2) 



So cial Studies 

Arts & Sciences 2.2(2) 17.6(16) 

Teacher Education 4.5(6) 8.9(11) 

Bachelor's 3.3(6) 12.0(22) 

Master's 6.3(2) 15.6(5) 



26.4(24) 
32.3(40) 

28.6(52) 
37.5(12) 



33.0(30) 
22.6(28) 

28.0(51) 
21.9(7) 



20.9(18) 
30.5(39) 

28.0(51) 
18.8(6) 



Mathematics 

Arts <5c Sciences 5.0(2) 

Teacher Education 0 

Bachelor's 1.1(1) 

Master's 14.3(1) 



5.0(2) 
14.5(8) 

10.2(9) 
14.3(1) 



17.5(7) 
20.0(11) 

17.0(15) 
42.9(3) 



32.5(1.3) 
30.9(17) 

33.0(29) 
14.3(1) 



40.0(16) 
34.5(19) 

38.6(34) 
14.3(1) 



Scie nce 

Arts & Sciences 2.8(1) 5.6(2) 

Teacher Education 0 12.5(6) 

Bachelor's 1.3(1) 9.0(7) 

Master's - 0 16.7(1) 



8.3(3) 
16.7(8) 

14.1(11) 
0 



38.3(14) 
31.3(15) 

37.2(29) 
0 



44.4(16) 
39.6(19) 

38.5(30) 
83.3(55 
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^Numbers in parentheses indicate numbers of teachers 
Lye to rounding totals may not eqpal 100%. 
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For all teachers at the bachelor's level, arts and sciences majors score slightly 
above the teacher education graduates, but do not score as well at the master's level. 
If scores within programs are compared by level, the differences between the bachelor's 
arid the master's level are much greater for the teacher education group. This may be 
ah indication of selection processes that are taking place in the teaching profession, 
or the testing process itself* Since the TCT has been designed to test minimum compe- 
tencies and its content is no more complex than the curriculum of the Georgia public 
schools, it probably does not test higher complexities in the subject area$ However, 
teacher education graduates possessing a master's degree outscore all other groups 
for this txjpulaticn. - 

These conclusions are derived from analyses of data for teachers who have been 

hired for Teaching positions, and who have passed the TCT with at least a scaled score 

? 

of 70. It therefore does not reflect upon a total number of pe^ons prepared in teacher 
education program, or arts and sciences programs. Hie data does supper ! the general- 
ization of the two years of test data for employed teachers to a larger group which 
Has been tested over a period of time, and has similar characteristics to the selected 
population in terms of programs and experience- | 
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A Study 6i Scores on the f^atiooaJ Te*ct*er Ex^iriatiom 
for Teachers with Regular and Tcm porary Cectilicalion 

in Louisiana 



This is a study to examine the differences between the scores on the National 
Teacher Examinations (NTE)--both the Common Examinations, and selected Area Examinations 
for two groups of teachers: 1) those who have completed & regular teaching education 
program leading to a. bachelor's or. master's degree ahef have regular certification, and 

2) those who have completed arr&rts and scjehces program leading to a bachelor's or 

______ _ \ 

master's, without the necessary hours to be a fully certified teacher in Louisiana* \ 

The variables of the study were: 

1. The scores o\i the Weighted'Common Examinations of the National teacher 
Examinations (NTE). 

2. The scores or, the Area Examinations oi the National Teacher Examinations. 

3. The number of hours of professional education completed. 
^. The type of program completed. 

5. The area oi certification* 

Population .. *S* 



The population was composed of all "teachers who received certificates to be v * 

employed in the state of Louisiana from 5u!y 1982 to Mf 1983; all had met the minimum 

> i 

NTE scores necessary to be certified. r : 

In Louisiana, teachers who have not graduated from an approved teacher educatiori 
program or do hot ho fit the necessary hours for certification may be given temporary 
one-year certificates upon request of the employing district These cer^xitc^es expire 
at the end of one year, but may be renewed by taking 6 hours of coursework leading 
to certification. * 
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the total population of teachers who were Issued temporary certificates during 1982-83, 
and Held no other regaiar certification in the state, was used in the study (N - 89), 
In this group, the number of education hours taken ranged from 0 to 36, with an average 
of 9.5 hours. The average number of education hours for those taking the elementary 
education test was 13* It was determined that these hours had been obtained before 
taking the NTE tests. Eighty-three (83) of the teachers possessed bachelor's degrees; 
6 held the master's degree. Of the group, 21 had taken the NTE Education in the Elemen- 
tary School examination; 10 had taken the social studies test; and 9 had taken the English 
Language and Literature Examination. Degrees in psychology (13) and English (9) were, 
the most Common. Twenty-six of these teachers held temporary certification in elemeh- 
tary education, with 22 in special education. 

A random sample d! 105 teachers with regular certification was drawn from the 
initial population. Twelve b! this sample held master's degrees, the remaining 93 
held bachelor's. The most common certification area was elementary education (42), 
followed by physical education (13), English (9), and special education (9). 

Data CoUeci ion 

The computer data base of the state of Louisiana, as well as certification records, 
were used for data aggregation. All data were treated as group data* with no identifica- 
tion of individuals at any time. 

Instru m entati on 

National T eacher E xaminations . The National Teacher Examinations (NTE) are 
composed of Area Examinations and Weighted Common Examinations (WCET). The 
Area Examinations test the content of a special field of major in undergraduate education. 
Scores range from 250 to 990. Area Examination scores cannot be compared across 
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areas, and even though scores appear to be similar* a particular score does not represent 
the same level of proficiency from test to test. The tests measure principles 
and concepts from teaser education programs (ETS, 1981). Scaled scores approximate 
interval data. Reliabilities are reported to range from .91 to .95 (Kuder-Richardsori 20) 
with a standard error of measurement from 20 to 29 for most tfcsts (ETS, 197S5. The 

Education in the Elementary School Examination focuses on the natufe of the child 

_ _ j . . . _ 

and the process of teaching in the elementary school. The nature of the child includes 

child development and individualization. The process of teaching includes classroom 

organization, diagnoses of student heeds, and evaluation. 

The Weighted Common Examinations (WCET) consist of a test in professional 

education and one in general education.' The latter has 3 subparts— written English 

- expression; social studies, literature, and the fine arts; and science and mathematics. 

The WCET total score is a combination of the above tests with the following weighting: 

professional education— 4.0, social studies— 2.5, written English expression— 1.0, and 

science and mathematics--2.5. The coefficient of reliability (Kuder-Richardson 20} 

for the WCET is reported to be .96, with a standard error of measurement of 21. A 

combination of the WCET arid the Area Examination produces a composite score with 

ranges from 500 to 1980 (ETS, 1978). Tests have been validated against content of 

teacher education programs by the state department of education. 



Statistical summaries of data were obtained on the WCET scores for all teachers 
in the two groups, and for teachers with no education hours. Analyses of the WCET, 



had taken the Education in the Elementary School Area Examination. Because of small 



Analyses 



Area Examination scores, and composite scores were completed for the teachers who 



numbers, no other subject area groups were analysed. 
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Results 



WCET mean test scores for the two groups of teachers varied— tfilrtemporarily 
certified group as a whole scored higher (619) "than the regularly certified teachers 
(602); the temporarily certified teachers who had taken rib professional education courses 
also scored higher (611) (see Table 5). The same pattern held true for the teachers 
taking the elementary education test (630 versus 590J* For the mean scores on the 
elementary education area test the reverse was true; temporarily certified teachers 
scored 23 points lower than the regularly certified, however, the temporarily certified 
teachers received composite seores 17 points above^the regularly certified teachers. 

TABLE 5 

Scores on the NTE Weighted Eommon Examinations (WCET) and the 
Education in the Elementary Schooljftrea Test for 
Louisiana Teachers holding Regular and Temporary Certificates 



Temporary Certificates with All 

0 Education Hours Temporary Regular 



AUJTeachers 



Number 35 89 105 
WCE T Scores 

Mean 611 619 602 

Standard Deviation 5*?. 8 56.2 58.9 



Teachers taking Elementary Education Test (NTE) 
Number 

Area Test Scores 



21 42 
628 651 



Wean 

Standard deviation 42.2 
WCET Scores 

Mean 630 -fP 

Standard deviation 52 . 8 51.8 

Composite Scores 
Mean 



1258 1241 



Standard deviation 87.8 84,3 
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Conclusion 

the teachers in this population who had received little or no training in profes- 
sional education appeared to be able to score better on the WCET than those who had 
completed a regular sequence of education courses* even though $0 percent of the 
WGET is weighted for professional education content. Temporarily certified teacher's 
with no education hours outscored the teacher education group; General education 
or specialized content courses may make up for the lack of education courses, or possibly, 
there were Undetermined differences between the groups taking the test. It is interesting, 

however, to note fiat for the more specialized information that is measured on the 

U 

elementary education area examination, the teachers who had hot completed a teacher 
education program (an'average of 13 hours of education courses) did not score as high 
as those who had. 
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A comj»rispn of the Ferf otmance of Classroom Teachers in a 

Metropolitan School District who have 

Graduated from Arts and Sciences or teacher Education Programs 



This is an examination of the performance of classroom teachers, as measured 
by a locally designed teacher evaluation system, for two groups: 1) those who have 
regular certification in the state of Georgia (having completed a teacher education 
program or the necessary hours for certification), and 2) those who hold provisional 
certification because of a lack of the necessary hours in professional education courses. 
The variables for the study were: 

1. Scores on the district teacher evaluation instrument. 

2. j Type of certification held by the teacher: regular (the teacher had completed 

a teacher education program or the necessary hours of professional education) 
or provisional (arts and sciences graduates who had not taken the necessary 
number of education hours to be regularly certified). 

3. Teaching assignment. 

U. Years of experience as a classroom teacher. 
Population 

All teachers who were graduates of arts and sciences programs (provisional certifi- 
cation) in the district during the 1982-83 school year (no regular certificates in any 
area--N = 21) were included in the study. Eighteen of these were secondary teachers, 
three were teachers at the elementary level. Of these, ll were first-year teachers; 
the overall average was 2.3 years experience. A random sample of all regularly certified 
teachers was drawn (N = 27) for comparison. Of these, 13 were secondary and 1* were 
elementary teachers. In this group, only one tfas a first-year teacher. The group had 
an average experience level of 7.3 years. Because of the differences in teaching levels 
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and years of experience, a second sample was drawn. It was matched as closely as 
possible by subject area and by years of exjierience. Since no first-year teachers with 
regular certification are assessed in the district because of the statewide evaluation 
in Georgia of beginning teachers, it was necessary to move the experience level up 
one year for the sample. That is, 11 teachers at the second year of experience were 
used, and so on. The experience level for the second group was 5.2 years; subject area 
and level taught were matched* 

Data Collection f 

Ail data was obtained from school district records, with no identification of any 
individual at any time. AH data were grouped for reporting purposes. 

Instrument ation 

The evaluation instrument, Teacher Performance Observation Record, used in 
the district was developed from a statewide evaluation instrument for assessing beginning 
teachers in Georgia. (See Appendix C for a copy of the instrument.) Evaluations are 
completed by the principal in each teacher's school. AH principals in the district have 
undergone training m use of the statewide instrument; this county assumes that the 
training carries over to the district instrument. The distrtS^strument contains 10 
categories or competencies with 33 indicators under the competencies. Scores 
range from 1 to 5 on each indicator; a level of U or 5 indicates a satisfactory 
level, depending on the indicator. The following are the competencies: 

Plans Instruction 

Uses Techniques, Methods, arid Media Related to the Objectives 

Communicates with tearners 

Demonstrates a Variety of Teaching Methods 

Reinforces and Encourages Learner Involvement in Instruction 
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Demonstrates an Understanding of the Subject 

Organizes Time, Space, Materials, and Equipment for Instruction 

DeitK.iStrates Enthusiasm for Teaching, Learning* and the Subject 

Helps Learners Develop Positive Self-Concepts 

Manages Classroom interactions 

Statistical summaries for both groups (regularly certified, or provisionally certified) 
using the population data for the provisional group and the two sample groups with 
regular certification were completed. The small numbers in all groups must be taken 
into consideration when examining th^results of the study* 

Results 
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The ranges of scores for the provisionally and regularly certified teachers were 

distributed as follows: 

TABLE 6 

Score Ranges on the Teacher Performance Observation Record for 
Provisionally and Regularly Certified Teachers 



Numbers of Teachers 



Total 
Scores 



Provisional 
Eicatioh 



Regular Certification 
First Sample 



158-165 
151-157 
1W-150 
137-1*3 
Below 137 



6 
7 
t 
1 
3 



22 
2 
2 
1 
0 



1* 
k 
2 
1 
0 



The mean score for the provisional teachers was 150, with a standard deviation of 17. 
The scores ranged from 90 to 165 of the possible 165. Classroom experience averaged 
2.3 years. For those teachers holding regular certificates in the first sample, the mean 
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sebre was 160; with a standard deviation of 6. The scores ranged from 1*0 to 165. 
The teachers averaged 7.3 years of experience. The mean score for the second sample 
was 158, with a standard deviation of Be The scores ranged from 1^6 to 165. The teachers 
averaged 5.2 years of experience. 



The teachers with regular certificates had higher performance ratings than the 
provisionally certified ones; however, the former were considerably more experienced 
than the latter group- the scores of provisional teachers showed a broader distribution 
than those for the regularly certified teachers. Most of the regularly certified teachers 
received perfect or nearly perfect ratings on most competencies. Since a score of 
% or 5 is heeded for a satisfactory rating on competency, the total scores indicate that 
a very small percentage of the teachers are receiving less than satisfactory ratings, 
especially the highly experienced teachers. Oh the other hand, a larger proportion 
of the provisionally certified teachers received lower ratings. 

Whether or not the results Indicate an essential difference in the groups or a 
difference due to experience levels cannot be concluded from the data. It does appear- 
that the instrument may be Used by principals to assess strengths and weaknesses to 
a greater degree for those teachers who are either less qualified according to certificates 
held or jess experienced. The principals may tend to rate ah experienced teacher high 
on all categories because of other factors. 

All conclusions should be made with caution due to the small numbers included 
in this study. 
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A Comparison of Pert ormance and Test Scores for a 
Selected Population of Teachers with 
Provisional and Regular Certification in North Carolina 

this study examined scores on teacher certification tests and on-the-job evalua- 
tions to determine if differences exist for two groups of teachers: 1} those wjth provisional 
certification arid 2) those with regular certification. Teachers with provisional certifica- 
tion have completed arts arid sciences programs at the baccalaureate level or have - 
90 hours leading to a degree, these teachers do riot Have the necessary hours of profes- 
sional education for a regular certificate. Teachers with regular certification have 
a bachelor's degree in teacher education br a program which includes the necessary 
hours of professional education courses. The variables of the study were: 

1. The scores on the National Teacher Examinations: Weighted Common Examinations 
(WCET), area test score, composite score (combination of the WCET and area 

test score). 

2. On-the-job performance as measured by two typSs of evaluation instruments: 

a statewide instrument recently developed for the purpose of evaluating classroom 
teachers (North Carolina Teacher Performance Appraisal Instrument) 2ind district- 
designed instruments used for the evaluation of teachers within a district. 

3. The type of certification held by each teacher. 

U. Experience level of each teacher at the time of the evaluation. 
5. Degree level. 

Populati on and Sam ples 

Evaluation of Teacher Performance . All teachers who were employed with provisional 
certification during the school years 1978-79 to 1982-83 were included in the selected 
population of provisionally certified teachers or the arts and sciences group (n * 191). 
Of this population, 31 of the teachers possessed less than a bachelor's degree. A random 
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sample of 3*8 teachers was selected from a population of 21,000 teachers who held 

* ____ ._ _."\ 

regular certification at the bachelor's level and had been certified in North Carolina 
from 1978-79 through the 1982-83 school year. 

For the population of provisionally certified and the sample of regularly certified 
teachers* on-the-job evaluations were requested by the North Carolina Department 
of Public Instruction from the districts. For the regularly certified teachers, the last 
district of employment was contacted for evaluations. For the provisionally certified 
teachers, the district where the teacher was employed was contacted. Of the original 
539 names sent to districts, 292 evaluations were received. The return rate for the _ 
provisional teachers was 59 percent; for the regularly certified group it was 51 percent- 
Reasons for non-return of the evaluations included reluctance by districts to release 
the data and the non-availability of evaluations requested. For all teachers in the 
provisional group ho upgrading of certification to regular status had been made, although 
the number of professional education courses or staff development hours taken since 
receiving the provisional certification was hot known. 

National teacher Examinations . In addition, because the NTE data for 5 years 
were available for the provisionally certified teachers as :well as regularly certified 
teachers* these data were used for the analyses of the scores on the National Teacher 
Examinations. Scores were not available for all members of the populations because 
some teachers had received certification before the date the NTE was required, or 
because Graduate Board Examination Scores were used in lieu of NTE scores. 

Data- Collect ion i 

AH data were obtained from the North Carolina Department of Public Instruction. 
No individuals were identified and all information was confidential. 
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Instrumentation 

Performance Evaluation* Two general types of evaluations were used in this 
study to examine the performance of the two groups of teachers: the North Carolina 
Teacher Performance Appraisal Instrument and district-designed evaluation ^instruments 
used in local school systems* The statewide instrument was developed to carry out 
legislation of the North Carolina Genera! Assembly which mandated performance standards 
and criteria to be used in evaluating all public school professional employees. The 
Teacher Performance Appraisal Instrument provides for evaluations to be made in 
three general areas: broad program functions, particular technical functions, and indirect 
facilitating functions* The instrument contains 33 basic elements of teaching which 
are rated by the evaluator. Evaluators are school principals, trained by the State Department 
of Public Instruction. No reliability information was obtained from the Department. The rating 
scale on the Instrument provides 6 choices from "unsatisfactory performance" to "superior 
performance," with a "not applicable" category. {See Appendix D for a copy of the 
instrument.) However, because oi local variations allowed, school districts used various 
combinations of the 6-pbint scale. For analytical purposes, the evaluations were grouped 
into four types— A, B, C, and D (see Appendix E). All used "meets performance standards 
or expectations** with categories above and below to indicate less than satisfactory 
or above satisfactory performances. To equate the instruments, the ratings oh the 
statewide instrument were converted on each basic element to "meets standards" (=3), 
"below standards," (= 2), or "above standard expectations 1 * (= 4). "Not applicable" ratings 
were scored as 0 arid omitted from a final mean score for each teacher. A total mean 
score was obtained as well as mean scores for each of the three general areas. Mean 
scores ranged from 2,9 to fc.Q. (See Appendix E for types and means of scoring systems.) 
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The district evaluations, unlike the statewide instrument, varied considerably. 
Some contained rating scales, others were written descriptions of the teacher's performance 
in arid out of the classroom. Two irKJepehdeht raters subjectively rated the evaluation 
given tne teacher by the principal bri a 5-pbint scale: I = decidedly below average, 
2 = below average performance, 3 = meets standards, * = above average performance, 
and 5 = decidedly above average; An 82 percent agreement was r eached between the 
two raters. The 3 -point scale similar to that applied for the statewide instrument 
was then used. Ail ratings of 1 cecame 2, and ail ratings of 5 became $ to convert 
to a 3-j?oint scale. 

National Teacher Examinations . Scores on the Weighted Commons Examinations 
(WCETJ; the Area Examinations, and the composite score were reported for the groups. 
(See the Louisiana study for a discussion of the instruments.) 

Ana Ivses 

Ail data were analyzed using the SPSS statistical package CNie, et ah, 1975}. 
Statistical summaries and distribution of these scores by experience level as well as 
score ranges were calculated for both groups, and By type of instrument (statewide 
or district level). Statistical summaries of the test data were computed for the Weighted 
Common Examinations (WCET), 

Results 

Ev aluation of Teacher Perf ormance. Of the total number of evaluations used 
in the study, half were the statewide instrument arid the other half were the various 
district evaluations. An examination of the rnean scores on The statewide instrument 
indicates some differences for this group of teachers, in terms of the type of scale 
which was adopted by the local district during this first year of implementation. The 
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largest difference occ Jrs between the scale 'which uses 4 choj5o (fevalaatS6n.Tyj>e"A), 
two of wKicn are below satisfactory arid one above, as compared to a scaJe of 5 choices • 
(Evaluation Type C) of which two are below and two above satisfactory, t^owever, 
the means by which the final score was tallied— using only scores of 2 for btMow average, 
3 for satisfactory, and 4 for above satisfactory—could be an explanation for the results 
(see Appendix E). K ~*] ^ 

The mean scores for all evaluations, for all teachers, did not differ foi the two 
-groups: those who had regular certification a$d those who possessed provisional certifi- 
cation after having completed an arts and sciences program br\ in a limited number 

-of cases* having no degree* Differences were hot noted for breakdowns by years of 

\ 

#_ _ 

experience at the time the teachers were evaluated. The same pattern was found regard- 
less of type of evaluation instrument used (see Table 7); In examining scor^ for competency 
areas on the Teacher Performance Appraisal Instrument (such as fanning, the technical 
functions in the classroom, or the indirect facilitating functionsXlittie difference 
was noted. <. N 
For both district and statewide evaluations, there was no real difference in the 
distribution of scores between regular and provisionally certified teachers* nor between 
experienced and less experienced teachers* Very few teachers in either fcroup score 

below the satisfactory levels^ In ractfTT^rCerit and S3 percent of all teachers were 

* 5 

ra^ed at the highest levels under the district and statewide Evaluations, respectsveiy 

. * . _. : . , i 

(see Table S). An examination of the distribution of scores for ail teachers reveals 
that less than 3 percent scored in the lowest range on the ^statewide instrument. A^prox- 
irtiately 12 percent scored in the lowest range oh the dfhrict evaluations* The numbers 
of ftrs-t-year teachers evaluated on th^ 1 statewide iristfumer^js SfcaU and results should 
be interpreted with Care* 
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TABLE 1 



Mdm Scores lor On-thc-Job Evaluations ol' 
Regularly a fid Provisionally Certified Tellers in North Carolina 



Regular 



:ar CeKificatioh T Provisional CerUlicaiibo 



Years of 
Experience 



All Evaluations (N.i 292} 
I year or less 
_5 years or less 
More than 5 years 
Totai 

Distnct Evaluations fN 
f year or less 
5 years or less 
More than 5 years 
Total 

State Evaluations (N - i*6J._ 
1 year or less t ' 

subscore X* 

subscore Y 

subscore 2 
5 years or less 7 2 

subscore X 

subscore Y 

subscore 2 
More than 5 years 75 

subscore X 

subscore Y 

subscore 2 
Total : 



Mean Standard 
Score D^viat ?on 



_Mean,^Stan<iaf_d 



!) 




+. — 

- \ 




3.3 


. 6 




3 . >' • 


.5 




3.3~ 


< 




3.3 


. 5 


s 






52 


3.£* 




67 


3.i* 




15 








1 . 6 


;7 



3.3 
3.2 
3.3 
3.3 
3.3 
3-2 
3.3 
3.3 
3.3 
3.3 
3.6 
5.3 
3 ; 3 



>. 



37 


2.? 




73 


3.5 


.6- 


^9 


3.3 


.6 




3 . 3 


.6 


31 


* ^ 3 


* ' 




3.* 


- ? 




3 . 3 






3 . 8 





3 . (- 

3;* 
3.3 
3.3 
3.« 
3.3 
3.3 
3.2 
3. 3 
3.3 
3.3 



* Subscbie X; broad program functions which include operating and updating 

~ ~ " :h$ instructional programs 

SuBsCor* V: technical tenet ions which .refer to the means by which th* 
teacher carries out daily instruction 



SubscbreJ: indirect iicilitaiing functions which do not involve teachers 
or students . V..- 

_ ;,7 
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TABtE S 



eross-tabaiations of Mean Scores for bn-the-3ob Evaluations 
of North Carolina teachers by type of Certification 



District Evaluations 



First-Year Teachers (N = S3) 
Regular Provisional . All 



All Teachers (N = 156) 



Regular Provisional Ail 



Scored 

Number (5) (d) (9) 

Row Percent x 55;6 55;5 10.8% 

Column Percent \ 9.6 12.9 

Total Percent ^6.0 5.8 

Score -3 

^Number 1235 W (32) 

Row Percent 71.9 2S.1 38.6% 

Column Percent 5<j.2 29;0 

Total Percent -27 .7 10.3 



(8)n 
55.5 
9.9 
5.5 



(335 
61 .6 
40.7 
22.6 



( V0) 
55.6 
15.5 

6.8 



(21) 
38.9 
32.3 
15.5 



(18) 
12.3% 



37.0% 



Score =5 
Number 125} 

Row Percent 37 . 1 

Column Percent 56.2 

Total Percent 28.9 



as) 

52.9 
58. 1 

21,7 



in) 

50.6% 



55.1 
59.5 
27 .if 



(3*0 
5 5.9 
52.3 

23.3 



(75) 
50.7% 



(52) 
62; 7% 



(31) 
37.3% 



(83) 
100.0% 



(Si) 
55.5% 



165) 
i)* . 5% 



(156) 
100.0% 



Scores = 2.0-2.6 
Number 
Row Percent 
Column Percent 
TotajLfi**fecrft~~ 



Statewide Evaluation Instrument 



First -Year Teachers (N = 21) 



Regular Provisional 



AH 



All Teachers (N s 21) 



Regular Provisional 



(3) 
60.0 
3.1 
2.0 



(1) 
50.0 
2.1 
0.7 



All 



(5) 
2.7% 



Score 



Number 
Row Percent: 
Column Percent 
Total Percent 



(10) 
33.8 
67 J 
57. S 



(2) 

33 „ 3 
9.5 



(S2) 



57.1% 



(57) 
71.3 
58.2 
38.8 



(23) 
23.8 
57.9 
15.6 



(80) 
55.8% 



Score s 3.5-5 .3 
Number _ 
Row PeroenT" 
Column Percent 
Total Percent 



(5) 
-55.6 
33.3 
23,8 

(15) 
71 ;5% 



(5) 
if5.5 
66.7 

19. e 



(6) 
28.6% 



(9) 
52.9% 



(21) 
ISG;0% 



(38) 
SI - 3 - 
38.8 
25.9 

(98) 
67,1% 
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to rouridiftg totals may not add to I0d;0 percent* 
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(25) 
38.7 
50.0 
16.3 

(585 
32.9% 



(62) 
52.5% 



(156) 
100.8% 



no 



National Teacher Examinations . The Weighted Common Examinations (WCET) mean 
score for the provisionally certified (arts and sciences graduates) was slightly higher 
than for the regularly certified teachers or teacher education graduates (see Table 9). 
Breakdowns of the WCET scores by subject area were hot available because of small 
numbers- Area Examination scores and Composite scores were hot reported for the 
same reason. 

TABLE 9 \ ~ 

Results on the National Teacher Examinations (WCET) for a 
Selected Group of Regularly and Provisionally 
Certified Teachers in North Carolina 

Regular Certificates Provisional Certificates 

Number 15,6§§ ; US 

Mean Score 580 ,582 

Standard Deviation 78 96 



^^>c^n~c lusi on « , 

Evidence concerning the 6n-the-jo£ performance of teachers as evaluated by 
school principals shows that there was very little difference between the teachers 
who had completed a teacher education program or the necessary hours for regular 
certification, and those with provisional certification. Additional training and numbers 
of professional education courses that had been completed by the provisionally certified 
teachers are not known. In terms of performance, as measured for beginning teachers 
with one year of experience compared to those with more experience, there were no 
differences. The instruments and methods of evaluating teachers appeared to place 
the majority of teachers in a very favorable light. The use of the statewide instrument 
for this group bleachers indicates that very few (less than 3 percent) of the teachers 
evaluated fell into a less than satisfactory category, based on a total score. 



These results call into question whether or not these instruments are discriminating 

. V .. . 

enough to reveal real differences that might occur. between teachers, regardless of 

how they were prepared. Similarity in the means of a total score may h$t be revealing 

weaknesses in particular areas, although for the statewide instrument the breakdown 

by functions such as planning, classroom activities, and activities outside the classroom 

revealed no differences for the two groups, the purpose of the instruments is to identify 

weakness areas and to serve for decision-making within the districts, hot for comparisons 

$ 



of groups of teachers. 

On the other hand, if the instruments are valid for these purposes— and they are 
being used as the bases for employment decisions within districts— the ability of those 
persons who have not finished a traditional teacher education program or have not 
accumulated enough hours to become regularly certifiicTto attain similar ratings oh 

these types of instruments indfcate that they appear to be functioning as well in the 

-5* _ - 

classroom as those who have completed the necessary requirements. At least weaknesses 

and strengths are identified to ah equivalent degree through the use of the instruments. 

The scores of the Weighted Common Examinations, which to a large extent deal 
with professional education, reveal that the arts and sciences graduates outscore the 
teacher education group to a slight degree; the scores should be interpreted as roughly 
equivalent. A breakdown of scores within the WCET needs to be examined to identify 
areas of weakness or strength for each group. Conclusions related to area te|t scores 
were not available because of small numbers of teachers^ each subject area. 

All interpretations of the data, both for teacher evaluations and for teacher test 
scores should be interpreted with the populations and samples in mind. Generalizations 
to any other groups should be made with caution. 
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DISCUSSION OF THE FOUR RELATED STUDIES 

The regular certification of arts arid sciences graduates who have hot completed 
the necessary professional education courses has become state policy recently in several 
states; other states are discussing the issue. These four studies provide data oh two 
research questions related to this policy: 

1. What, if any, differences in scores on teacher certification tests occur for two 
groups of teadlers: those who have completed teacher education or certification 
programs and those who are temporarily certif ied (arts and sciences majors)? 

2. What, if any, differences occur in on-the-job performance of such groups of teachers, 
as measured by evaluation instruments currently in use? 

-■is 

y 

Teacher Certification Tests 

The results of these studies reflect data for employed teachers from iselected 
populations and do not necessarily indicate how all graduates might perform on teacher 
certification tests. All teachers in the studies had received scores at or above the 
minimums needed for certification in each state. 

Research has not established a relationship between scores on teacher certification 
tests and student achievement or attitudes in the classroom. Neither has it established 
what minimum level of knowledge is heeded by ah effective (as defined in terms of 
student achievement) teacher in the classroom. However, states across the nation, 
especially in the South, have mandated that teachers must pass minimum competency 
tests in general education, professional education, subject matter knowledge, or com- 
binations thereof, to insure that Teachers being granted certification possess a minimum 
level of knowledge to be able to function in the classroom. 

\h these studies, graduates of arts and sciences programs who had provisional 
or temporary certification generality outscored teacher education graduates in tests 
of general education and professional education (NTE Weighted Common Examinations), 
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despite the fact that kb percent of the WCET score^was weighted for professional educa- 
tion content. The arts and sciences graduates had completed varying amounts of profes- 
sional education courses; however, the scores of the temporarily certified teachers 
in Louisiana who had not taken any professional education courses prior to taking the 
WCET attained higher scores than the teacher educatior^graduates. 

Test results on subject area examinations were compiled from the NTE Area 
Examinations and the data from the Georgia Teacher Certification Tests* which are 
heavily weighted toward subject matter content, although some professional education 
ts included. The Georgia data revealed a greater difference by level of degree (Bachelor's 
or master's) than by separation between teachers possessing regular or provisional certifi- 
cation. At the bachelor's level the arts and sciences graduates in general scored slightly 
higher as a group, but at the master's level the teacher education graduates out scored 
the arts and sciences persons. Whether this is a function of the selection processes 
employed or the fact that the test is designed to test minimum levels of subject matter 
cannot be ascertained from this study. 

Because of the small numbers associated with the respective NTE scores, data 
could hot be analyzed by level, and no generalizations other than those made for elemen- 
tary teachers were possible. The teacher education graduates in elementary education 
outscored those who were provisionally or temporarily certified on the Area Examinations 
in Louisiana. It appears oh the basis of these limited data that at the elementary level, 
in the specialized knowledge tested for in the NTE Area Examinations) the teacher 
education graduates are more knowledgeable than the arts and sciences graduates. 
Because of the small number of teachers being provisionally certified in Georgia for 
elementary education, no findings were possible. The differences for the elementary 
and secondary fields may indicate similarities in terms of content focus at the secondary 
level for both teacher education and for arts and sciences graduates. The fact that 
programs to prepare elementary teachers are generally weighted toward the teaching 
of children—tested for in the area test—could explain the differences. 



Evaluation of G>n-the-3ob Performance- of Teachers 

> 

The data from these studies indicate few differences in the on-the-job performance 
of teachers as measured by several types of currently used evaluation instruments 
in which the school principal is the rater of a teacher's on-the-job performance. 

The data from the Georgia metropolitan district do indicate that teachers who 
are regularly certified receive a better rating than the provisionally certified arts 
and sciences graduates when rated on the district instrument. Because of problems 
in equating years of experience and because of small numbers in the study, it is not 
known to what extent the differences are a function of the course background of the 
teacher or of the experience level. 

For the much larger North Carolina population, no differences were found between 
the provisionally certitied teachers and those with regular certification, hbr were 
differences found when the two groups were compared by experience level. The first- 
year teachers in both groups received similar ratings* which did not differ from the 
ratings of experienced teachers. 

Data from both groups revealed that for experienced teachers, most evaluations 
are at the satisfactory or above satisfactory level. This may be, in part, because those 
teachers who were not able to perform were no longer on the job or that principals 
tend to give similar ratings to highly experienced teachers. However, the North Carolina 
data show that even among first-year teachers, very few received a mean score which 
would be considered less than satisfactory. 

All the performance results should be examined with the knowledge that evaluation 
instruments have not been validated against student learning, and that the ratings are 
confined to the principals 1 perceptions of the ability of the teacher to perform a particular 
activity. The fact that few differences occurred in the North Garolina data in terms 
of type of certification or level of experience calls into question whether or not the 
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comparison Of performance in terms of a total mean score really reveals differences 
in the performance Of the teacher. On the other hand* the evaluations are designed 
for employment decisions and to identify weaknesses of the teachers. In this respect, 
the instruments do hot seem to distinguish between the two groups. 

Because of the nature of the instrumentation and the state of previous research, 
further studies are needed on other populations using the instruments examined in this 
study as well as other evaluation instruments. In particular, the instruments need to 
be validated against student achievement to determine whether or not the competen- 
cies being rated are those demonstrated by teachers who are effective in terms of 
student achievement. The ability of the school principal to effectively "rate" teacher 
competencies needs further research. 

Certification Of Arts and Sciences Majors 

For the populations studied, the data support the contention that, as measured 
by certification tests, arts bH sciences majors are as well-or possibly better-qualified 
than teacher education gra. .ates in general education, general professional knowledge, 
and subject area knowledge the secondary level. At the elementary level, more 
research needs to be conducted to determine if the preliminary indication of these 
studies that teachers prepared in teacher education programs have a greater knowledge 
of what is measured on the NTE Elementary Education Area Examination than the 
arts and sciences majors is similar for other populations. 

The studies reveal mixed results in terms of performance in thexlassroom. The 
North Carolina data, using different types of evaluation instruments, revealed no real 
differences, while the results from the Georgia metropolitan district, based on small 
numbers of teachers, favored the teacher education graduates. The instrumentation 
and the validity of the instruments for measuring the effectiveness of teachers is certainly 
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brought into question, the interpretation of the results of these studies must be made 
with that in mind. 

As states begin or consider to begin certifying arts and sciences graduates, it 

will be important to gather data oh teachers currently in the classroom as well as those 

JL_ 

who enter the classroom under these new circumstances. Regionwide pooling of data 

for research would be helpful. If certification is to function for quality control, then 

states heed to monitor practices and consider whether bid or hew policies are in the 

best interests of students. \ 



States also need to carry out further research to determine the ability of evaluation 
instruments to distinguish between the good and the poor teacher in the classroom. 
Can one generic instrument be used across all subject and experience levels? Studies 
on inclusion of data on student achievement and attitudes for validation of teacher 
performance instruments should be given high priority. 
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APPENDIX A 



GEORGIA TEACHER CERTIFICATION TEST RESULTS 
FOR A SELECTED POPULATION 





ALL* 


HUMANITIES** 


COMMUNICATIVE 
ARTS 


SOCIAL STUDIES 


MATHEMATICS 


SCIENCE 




Arts i5c Teacher 
Sciences Ed. 


Arts & Teacher 
Sciences Ed. 


Arts & Teacher 
Sciences Ed. 


Arts & Teacher 
Sciences Ed. 


Arts & Teacher 
Sciences Ed. 


Arts & Teacher 
Sciences Ed. 



UOv' ivtv, v * ' w 1 V* 


























Number 






)7 


lb; 






Li 


70 


19 


jt 


i ) 




Mean 

III * 


79.6 


78.6 


80.3 


79.0 


79.0 


77.5 


81.7 


79.9 


79.7 


79.0 


79.2 


79.7 


Standard Deviation 


5,2 


6.0 . 




6,2 


4.8 


U 


6,7 


: 67 


5.9 


' 6.1 


7.0 


6.3. 




























Number 


ill 


to 




IS 

JO 




?! 


hi 


ID 




U 


17 




Mean 


79.0 


78.1 


82,9 




79.2 


77.1 


82.0 


80. i 


77.7 


78.9 


77.5 


75.5 


Standard Deviation 


8.5 


5.5 


6.3 


5.8 


5.0 


5.6 


6.5 


7,0 


6.2 


5 .,6 


5.9 


3,0 


Masters 198I- 


























Number 


19 


31 


13 


22 


4 


9 


8 


10 


3 


3 


2 


' 2 


Mean 


81.1 


83.$ 


W.O 


it.i 


87.9 


80.9 


81.2 


84.8 


76.8 


88.9 


71.6 


73.9 


Standard Deviation 


7.6 


7.3 


7.1 


7.2 


3.6 


5.3 


7.3 


7.3 


8.6 


6,2 


4.0 


.50 


Master's 1982-83 


























Number 


18 


6 


15 


3 


2 


0 


12 


2 


1 


6 


0 


2 


Mean 


81.5 


86.1 


81.0 


89.0 


83.1 




81.0 


91.0 


95,9 






.83.7 


Standard Deviation 


6.8 


7.8 


6.1 


5.4 


4.8 


— 


6.6 


6 9 


: — 




— 


12,87 


Total=703 


























Number 


267 


m 




228 


58 


88 


90 


m 


40 


55 


36 


48 


Bachelor's 
Number 


230 


399 


119 


203 


42 


79 


70 


112 


36 


52 


34 


44 


Mean 


79.3 


78.6 


81.6 


78.9 


79.1 


77.5 


82.0 


79.9 


78.3 


78.9 


78.2 


78.8 


Master's 
Number 


37 


37 


28 


25 


6 


9 


20 


12 


4 


3 


2 


4 


Mean 


81.3 


'83.8 


82.4 


84.8 


86.3 


80.9' 




85;9 


81;3, 


88;9 


7t;7 


7S-S 






Jk™*~ — i — ^ 























Includes the total populatiorfwitH the following subject areas represented: communicative arts, social studies', mathematics, 
science, French, Latin, Spanish, German, business, distributive education, agriculture, home economics, industrial arts, 

»* Humanities includes communicative arts, social studies, and all languages (Spanish, French, German, Latin). 

NOTE: jSjibiect breakdowns are shown only for areas with sufficient numbers for analysis, ; - * 
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Educational Minimum i Preparation 
Degree Requirements Completed 

Barcaiaurcaie before 5/1 /SO 



VPEf) QF CERTIFICATES CURRENTLY iSStf D TO TEACH!: R$ IN GEORGIA 

enatio? 



Master's 



Before 5./J/S0 



On or after 



ft. 



On or after 5/1 /SO NT* 



T5 
NT* 

PBT5 
Nt5 

B5 

m 



" yrs renewable 
I yr extendable 
for 5 years 

5 yrs, convertible 
tbPBT 



! ?fi$«iidablc for 
2 years 

5 yrs renewable 
i ! - not renewable 



1 yr renewable lor 
2 yrs if professional 
courses 4 condi- 
tions* satisfied 

[ yr renewable 
5 yrs renewable 
) yrs convertible 
to P5T 

5 yrs renewable 
I yr not renewable 
I yr renewable 2 yrs' 
i vr renewable * times 



Provisos 



Ajj conditions* teve been met 
While all condiflpfis* arc being 
met 

All conditions* have been _met, 
and convertible to PBT aftar 
2 successful on-the-job assessments 

While all conditions* are being 
met 



After meeting on-the- job 
assessments 

All conditions 1 have been met 
except passage of CRT, cower • 
tibie to NT* on passage of CRT 

Field requirements are met, but 
lacks professional preparation 
and employer requests 



see T5 
see NT" 



see B* 
see PA5 



Source: Galambos, E. C, (1981): Ce^ajemj|oj^j^ for other states, Georgia Professorial Standards Commission, 

Atlanta, C A, " ' ~ • 

.. . ........ j... ........ 

'Conditions: Preparation finished after 7/1/76, and completed: exceptional children course* reading course, and mm of study require- 
, ments; If preparation finished after 5/1 SO; these requirements pern pius passage of Teacher Certification Tests. £ 

S. : Nonrenewable 

P8 s Performance-Based ' 
NB r Nonrenewabie Provisional 



yyc )visional §3 
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_ _ U^OjA VLTSOPpLiTAN Q!5TRICT_ _ 

TEACHER PERFORMANCE OBSERVATION RECORD 



COMPETENCIES AND INDICATORS 

PLANS INSTRUCTION 

1 Gl iptki^es o' ^eie-n> learner qme^iv^y for lessor* > .... 

* 02 Speo*^ or sek^rT* iearh;n& met ht/d* ?br lessors. 

* ut Spec's J:f ; s .or *£j*rcv% cohi^hr's, rh^k*fiaU and equipment for lessons _ . 

1 £4 *$p* ; o^* ; -\ o< • ?r.jw:,»Jv a no pr<>: ; far assessing ie^rner progress on 'He 

*■ 05 Pi«r-'j. fr'S^ j':"*-',"" a- ,5 ■- o' ipv *;»:••. . , . . . .... 

* idi-'r r *.r ; *-v ar*-:; s^jrhi-ffi -^ho the assignee' o; specialists . 

USES TECHNIQUES, METHODS. XND MEDIA RELATED TO THE OBJECTIVES 

„' • ;T.>;r .;-:i<<^^K-o;;C'' r:i "^ : *ntf oiHv tn$tfutt*t)fi«<i aids . .' . . _. . ". : - 



? 




f 


|1 


r 

1 


= 2. 

1 2 3 


</> _ 

4 5 


1 2 ? 


4 5 


1 2 3 


A 5 


1 2 3 


4 5 


1 2 3 


4 5 


12 3 4 


5 


12 3-4 




1 2 3 


4 5 


12 3 4 


5 


12 3-5 


5 


1 2 3 4 


5 


1 2 3 


S 


1 2 3 


4 5 



COMMUNICATES WITH learners 

i 1(i 3 '.'*ipbr''.,;j?:: r f .a to it^^ori f.,;-n?en' 

1. • ■•/ 4 P*J&*V *». T r?t*'f'i j ft pr*~> SK> r " With ■■ 

DEMONSTRATES A VARIETY OF TEACHING METHODS 

P?£iNF'ORe£S AND ENCOURAGES LEARNER INVOLVEMENT IN INSTRUCTION 

r; - • vr p'o-'vt: ■ a '"ifhvr! invoked >n lessons ] 2 3 4 5 

^ w.^n\-<,; ; ^ - wv.f-rr*-":' in ii'^on«: . 1 2 J 45 

: 3 \s r f -. ..■ • -,o , • v-k^^ t-" :, ! k enoMs of i^arht-rs *b rn^inUfn jrAoMMrurnt . . 1234 S 

"DEMONSTRATES AN UNDERSTANDING OF THE SUBJECT 

ORGANIZES TIME. SPASE; MATIRjALS, AND EQUIPMENT FOB INSTRUCTION 

" ;"J \ViF.'nzi\ rr. :v3: -*-^rf uhio'iiii - ....... 4 5 

7 ij f'hswjV. :r '>\,.r\m; »>r . ribrim^h' rhai is an f *H"ae ,^nri orc^^it . 12 3 4 5 

DEMONSTRATES ENTHUSIASM FOR TEACHING, LEARNING. AND THE SUBJECT 

8 .'A Cijrr^riijrrr^Jrt pi'^onal i; fc nt hus?»isHi '• . • • 5 

P > v. off.ve>v^ "hr- impfi^s-on at fcrtuwHip »hrfi ro do and ho v to <ir> it • • - 1 2 3 4 5 

HELPS LEARNERS DEVELOP POSITIVE SELF-CONCEPTS 

^ ^ r^r D^r ;; -?'-/ 5 ?M?»* ; sfwiiiv-irv to ifi** ne^ti^ ^nd feelings oi iea^u"'r; 1 ^ 3 4 5 



MANAGES CLASSROOM INTERACTIONS 

K; 5?.: f'- , . ?: ?*i ii'^r ^r. sA-<< ir rhri' J 2 3 4 S 

k .\ .--.^i'-.Tpri.^i ■ U\ -.'v>.;r? ; -n ( -i . ' 1 234 5 

■ - > ^ . ... , . ; • ■ ^ » ■ , . 1254 5 



ERIC 
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APPENDIX D 

NORTH CAROLINA 

TEACHER PERFORMANCE APPRAISAL INStRUMENT 



INSTRUCTIONS i. Svse^on the 4rMena>fr<y m oteervclim and discussion, the evaluator is to rate the teache?s 
P* r T 6r J®? n S. e Jp 33 basic elements of leaching listed below, 
2. The evaluator is encouraged to odd pertinent comments at the end of each major function 
3: The teacher is provided dh opportunity to react to the evaiuator's ratings and comments. 
4. The eyaluaior and the tmcher must discuss the results of the appraisal and drK- recommended 

Option pertinent to it: 
5- P?* th^l^Arrt t^foaior must sign the Instrument in the assigned spaces. 
; 1 The instrument must be filed in the teacher's &rsonhel folder. 



ichool 



The following on> Broort Program Fimc Uofvi. They refer to planning, operating, and 
apdaUhp the irM^ciia^aTprr^ram ax a total program extending over the school year. 



M.i::3r Function: rjdr^ing th~ P rogram 

!. Contributes as requested to the deveiop'-wnt of anriuii objectives for The. scnoc!. 

? .9? v * 'c^'* 3 *i I rrn?r liC ! ton ^ !. P* dn . ip ^Jud« _t_H^_ formulation of _ob jec t i ves, 
strategies* tv^clio^s, and evaluation p-oredures consistent with annual school objectives. 



R*tla& Scale 
(?ieiie Checfc) 



. a. 



f 



6 

u 

-J 2 

O 4J 

«J U 

5? 
0 



m ti 




Mgior Function: Oversee m^ the Pr^rjjrh 

1. Applies curriculum scope; sequence 4 continuity, and balance in carrying oat the 
annual instructional plan. 

?. Implements learning strategies that address the needs identified in the 
annua 5 instnJCtjbnai plan. 

Appropriate evaiuatjrn methods to determine whether the annual instructional 
plan ij working.* 

Ma*<es change * :n the annual instructional plan when evaluation indicates a need, and 
seeks advice and assistance •» needed; 



in 



n 



□□□□□ 
]□□□□□ 

!□□□□□ 



Major Function: ypdajtnjg t he P r qgr am, 

1 . Renews comjj*tffW> arid Keeps up w[th advances in child growth and development and uses 
th t 5 knowledge to improve the instructional program. 

2. Kenew i competencr and keeps abreast of new knowledge, research* and practice in subjec* 

II — 1| — if — i) — 

atea's) and applies tni* Knowledge to mprove the instructiohai program. L_ i ! I ! I I I I I 

Comments 



□□□□□n 



Note oa RgtlnR Scale: Any one of three rating scales was suggested for use in I982-S3: The five-point scale is Illustrated 
*? r ?L toyt.^ *^ "Sujxnor PcrfcrrTiahce ,, Category., The thr* >oint scale is obtairved 

by omitting the "Superior Per formarve" rategory and me "Performs i ^satisfactorily" category; 




RatinR Scal e 
(Fleaae Check) 



The following are Particular Technical Functions , they refer to ihemear^by^lch the 
teacher adapts the broad program functions 16 lessons and units of stony on a dally basis. 



D. Major Function: Managing Daily Instruction 

1. Prepares daily lesson plans, makes classroom presentations, conducts discussions, _ 
encourages practice, and corrects student work in a manner that demonstrates subject 
area competence. 

2. Correlates subject matter to students' interests, needs, and aptitudes. 

3. Uses resources, materials, and enrichment activities that are related to the subject(s). 

k. Employs instructional methods that are appropriate to the instructional objectives. 

5. Involves students, parents, and others as needed to help ensure th4i students keep 
up with daily lessons. 

Comments „ ~- — — — 
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1 


Cl 

U 

(a 






I 


r nr. 



□□□ 
□□□ 
□□□ 
□□□ 



□□□ 
□□□ 
□□□ 



Major Function: Differentiating Instruction 

1. Identifies students* strengths and weaknesses in relation to objectives to determine 
if grouping is required because of differing skill levels. 

2. Groups students as needed for effective teaching and learning. 

3. Uses the school's media Center to support and supplement instructional 
activities. 

U. Provides instructional activities that aid students in becoming independent learners. 
Comments — 



F. Major Function: individualizing Instruction 

i; Monitors individual student achievement of objectives as teaching occurs. 

2. Provides individual students with prompt feedback on their progress and provides 
necessary remediation. r 

3. Adjusts instruction to objectives and individual student needs on a daily basis: 

i; Arranges to have appropriate materials and equipment available to satisfy individual 
needs. 



Comments 



Major Function: Supervisin g 

j. Manages the daily routine so that students know what they are to do next and are able 
to proceed without contusion. 

2. Keeps student ta(k and movement at a level that lets each student attend to his or her 
instructional task without interruption. 



3; Maintains a pleasant working atmosphere that does riot stifle spontaneity and warmth. 
Comments — — — 



□□□□□ 
□□□□□□ 
□□□□□□ 
□□□□□□ 

□□□□□□ 
□□□□□□ 
□□□□□□ 
□□□□□□ 



□□□□□□ 
□□□□□□ 
□□□□□□ 
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Rating Scale 
(Please Check) 



The /lowing ^afreet FdciU talina Functions . They_ refer to c moderately related 

?§io[^qctl^tjes_that do not involve direct teaching between teacher and student, but have 
Important effects on the success of that direct teaching. Son-Instructional Duties refer to 
*M ^^tla[nleinj^e logistics of administering a program to a large social 

group of several hundred students In a limited space. 



H. Major Function: Human Resources 

1. Uses student talent as a resource in instructing, developing materials, and 
operating equipment. 

§ 

2. Makes appropriate use of volunteers and resource teachers with special skills and 
knowledge. 

3. Makes Use of appropriate community resources to extend classroom learning. 

<*. Ma;kes effective use of other professional personnel to improve instruction and 
classroom management. 



Comments 



Major Function: Haman Relations 

1. Shows respect for the worth and dignity of all students. 

2. is aware of and encourages respect for caltaral differences. 

3. Establishes rapport with parents. 

Comments — - — - 

Major Function: Non-Instructional Duties 

1. Carries out non-instructional daties as assigned or as a need is perceived; 

2. Adheres to established laws, rules, and regulations. 
Comments 
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□□□□□□ 
□□□□□□ 



□□□□□□ 
□□□□□□ 

□ I — 1 1 — 1 1 — I ! — 1 1 — I 

□□□□□□ 
□□□□□□ 



Evaluator's Summary Comments 



Teacher's Reactions to Evaluation 



E valuator's signature and date 



r^JclTerS signature and dat* 



ERJC 



Signature indicates. that the 
written evaluation has been 
seen arid discussed. 
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APPENDIX E 
NORTH CAROLINA EVALUATION COMPARISONS 



Regular 
Certification 



Provisional 
Certification 



Mean 



Standard 
Deviation 



Scales Used 



tate Evaluations (N=l**6) 



i j , — - - 



Type B 



39 



15 



Type C 



30 



10 



Type D 



28 



21 



i 

lean Score 

district Evaluations (N=146) 

(82% agreement between 2 raters 
using a 5-point scale) 



3,8 



3.1 



3.5 



3.3 



3.3 



3.* 



t ^ 



,32 



.35" 



.33 



.70 



\??/ h:v^3 nut n.iSci, j iaJ iucii vj 

(3) Meets minimum standard 

{U) Exceeds standard 

fa) Superior attainment 

(0) Not applicable 

(2) Performs unsatisfactorily 

(2) Needs Improvement in performance 

(3) Meets performance expectations 
fa) Exceeds performance expectations 
(0) Not applicable 

(2) Perform^ unsatisf actor ily 

(2) Needs i approvement inj>erformance 

(3) Meets performance expectations 
fa) Exceeds performance expectations 
fa) Superior performance 

(0) Not applicable 

(?) Needs improvement in .performance 

(3) Meets performance expectations 

fa) Exceeds performance expectations 

(0) Not applicable * 



JJUEvaiuations — Mean Score = 3.3 | 
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